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(57) ABSTRACT 

The method of the present invention allows a viewer/listener 
to schedule a future event based on information which is 
embedded in a multimedia presentation, such as a promo- 
tional commercial. The viewer or the viewer's equipment, 
on the basis of the viewer's preferences, causes the event to 
be scheduled at the appropriate time. The types of events that 
can be scheduled include: 

scheduling the reception of a future television/radio/ 
data download program, including turning the pro- 
cessing device on and switching to a correct channel 
or station; 

scheduling play of audio or visual reminders for 
informing of the imminent start of a scheduled 
program; 

scheduling the recordation of future program or data 
imbedded in such a program on a recording device, 
e.g., VCR, audio recorder, computer medium 
recorder; and 

schedule the downloading of data. 
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METHOD FOR AUTOMATIC AND 
SEMI-AUTOMATIC EVENT SCHEDULING BASED 
ON INFORMATION EMBEDDED IN MULTIMEDIA 
CONTENT 

BACKGROUND OF THE INVENTION 
[0001] 1. Field of the Invention 

[0002] The present invention is directed to viewing, lis- 
tening, and downloading data in a multimedia program, and 
more directly to a system and method for enabling sched- 
uling of a future viewing, listening, and data downloading 
event based on information presented in a current multime- 
dia program. 

[0003] 2. Description of Prior Art 

[0004] The current broadcast television environment is 
based on a scheduling concept. The content is broadcast 
according to a predetermined schedule. Television viewers 
either access content randomly, i.e., "channel surfing" or 
with a specific program schedule in mind. The schedule 
information is usually obtained from conventional means, 
such as printed schedules found in newspapers or from 
broadcast program guides, ITic broadcast program guides 
are the interactive or electronic program guides commonly 
included in most cable systems. The same is true for radio 
listeners and subscribers of the new satellite digital audio 
broadcasts. 

[0005] Broadcasters often advertise future content through 
the use of promotional ads, which describe a future broad- 
cast event. The advertisement is broadcast with the aim of 
attracting viewers to watch or listen to the event at the 
event's scheduled time. The viewers must either remember 
the schedule and tune to it at the appropriate time, or 
program a recording device to record the event. 

[0006] While systems for viewer navigation through 
broadcast multimedia presentations are known in the art, 
most arc based on the electronic program guide paradigm. 
This paradigm disconnects the program guide information 
from the television content i.e., audio and video, sending it 
as a separate entity. 

[0007] The capability to include scheduling information as 
part of a recorded multimedia presentation is known in the 
art. U.S. Pat. No. 4,802,038 describes a system for recording 
scheduling information concerning audio events, however 
this system is designed for this information to be used at the 
recording site and not broadcast to viewers. 

[0008] U.S. Pat. Nos. 4,381,522, 5,686,954, 4,977,455 and 
5,727,060 describe the use of electronic program guides for 
allowing viewers to interactively tune to broadcast pro- 
grams, typically through cursor navigation within an on- 
screen graphics matrix. The information that makes up the 
electronic program guides is broadcast as a separate stream 
and is not part of a multimedia presentation. 

[0009] U.S. Pat. No. 4,641,205 describes a menu-driven 
user interface for scheduling VCR programming of a future 
event. However, the menu information is general and is not 
related to any broadcasting schedule. U.S. Pat. No. 5,307, 
173 describes a means for programming a VCR on the basis 
of compressed codes. The system described is used in VCR 
Plus® systems. Aside from displaying the codes on the 
television screen when they are entered, there is no func- 


tional linkage between the programming of the VCR and the 
content viewed on the television. 

[0010] No means presently exist which will allow the 
viewer to interact with scheduling information which is 
provided along with the current video or audio presentation. 
Hence, no means presently exist to cause scheduling to 
occur based on a simple one-button selection from the 
controls of the receiving equipment, such as a remote 
control. Similarly, no means presently exist to cause sched- 
uling to occur automatically without a user^s current input 
based on user preference information which has been stored 
in a user's receiving device. 

[0011] What is needed is a system that allows the sched- 
uling information to be part of the multimedia presentation 
itself and provides an easy user interface to cause the 
scheduhng to occur. A system is needed, that allows sched- 
uling to occur semi- automatically under the direction of a 
user and assisted by embedded scheduling information, or 
automatically by the user's device without a user's current 
input. 

SUMMARY OF THE INVENTION 

[0012] A method is therefore provided for automatic and 
semi-automatic scheduling of events in the context of a 
multimedia presentation including audio, video and digital 
data. ITie scheduling information of a future broadcast 
program is ascertained and may be embedded into the 
content of a multimedia presentation. To enable automatic 
scheduhng, program description information (PDI) must be 
embedded as wcU. The presentation is then displayed on the 
user's television set, radio, a computer or any other receiv- 
ing device with capabilities of the present invention, 
depending on the data type. 

[0013] The receiving device determines whether schedul- 
ing information was received and extracts it by setting 
preferences, tuning a program selection, and then repeatedly 
checking the data queue in anticipation of scheduling infor- 
mation. In the case of semi-automatic scheduling, when 
scheduhng information is received and after waiting for an 
appropriate time, a user is notified of the availabihty of 
scheduhng information. The notification may be performed 
by varioxis means which are selectable by the user. 

[0014] The user then may make a selection, by a single 
key press on an input device, such as a remote control, to 
schedule a future event. If user's equipment includes a video 
monitor, the selection may be made using an on-screen 
graphics menu. Both the notification of the user and the 
making of the selection by the user are performed without 
interrupting the presentation being played currently. The 
presentation itself may be a video, an audio or any other type 
of digital data. 

[0015] In the case of automatic scheduling, the user's 
equipment, such as a set-top-box (STB) may perform the 
selection without the user's current input, on the basis of 
user preference information which has been pre-stored in the 
STB or other device. In this case, PDI, e.g., keywords such 
as "sports", "Lakers", or "Gary Cooper" must be embedded 
and transmitted along with the scheduling information. 

[0016] After the selection is made, the contents of the 
scheduhng information are processed by looping until either 
the notification time has passed in which case the notifica- 
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tion is terminated and the queue monitoriag is resumed, or 
the user has made a selection. If the user has made the 
selection, the notification is terminated and the process waits 
until the scheduled presentation time is reached. 

[0017] When the scheduled presentation time is reached 
the following functions for "schedule execution" may be 
performed: 

[0018] 1. tuning the receiving device to play the 
subsequent program; 

[0019] 2. recording a subsequent program or its 
selected embedded content at the scheduled time on 
an external video recording medium for video, on an 
external audio recording medium for audio, and on 
internal or external digital data recording medium for 
other digital data; and 

[0020] 3 . reminding the user of the scheduled event at 
the scheduled time, with a video or audio notifica- 
tion, which will allow the user to tune the STB 
device to play the program. 

BRIEF DESCRIPTION OF DRAWINGS 

[0021] The foregoing objects and advantages of the 
present invention may be more readily understood by one 
sldUed in the art with reference being made to the following 
detailed description of a preferred embodiment thereof, 
taken in conjunction with the accompanying drawings 
wherein like elements are designated by identical reference 
numerals throughout the several views, and in which: 

[0022] FIG. 1 is a block diagram of component interaction 
in an STB. 

[0023] FIG. 2 is a program flow diagram of a method for 
event scheduling based on information embedded in the 
multimedia content. 

[0024] FIG. 3 is a display of a multimedia presentation 
which includes scheduling information for viewer notifica- 
tion, showing a scheduling icon. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Preferred Embodiment 

[0025] In one embodiment the present invention is used in 
a broadcast television or broadcast video system. In another 
embodiment the present invention is used in a video-on- 
demand system. In yet another embodiment the present 
invention is used in an Internet streaming video system. In 
still another embodiment the present invention is used in a 
CD-ROM or Digital Versatile Disk video system. 

[0026] Authoring 

[0027] In order to supply the scheduling information about 
future presentations for automatic and semi-automatic 
scheduling, the scheduling information must be inserted into 
the multimedia presentation. To enable automatic schedul- 
ing, PDI must be embedded as well. In the preferred 
embodiment, this is done offline, through the use of an 
authoring system designed for this marking process and 
described in U.S. patent application Ser. No. 09/032,491. 


[0028] The scheduling information may also be added by 
the broadcaster in real time, while a multimedia presentation 
is in progress, by specifying the scheduling information to 
the user equipment, such as a Set-Top Box (STB) or, a 
digital television. The STB will use this information to 
notify the user about the future program, e.g.. News at 11:00 
P.M. on channel 4 or a sports program at 6:00 P.M. on 
channel 12. The choice of notification can be based on 
information already stored in the STB. 

[0029] The authoring system accepts as input video/audio 
content and scheduling information about a future content. 
An author steps through the present content inserting the 
scheduling information at appropriate locations. The present 
invention can be implemented for digital or analog trans- 
mission systems carrying video, audio, programs or any 
other data content. 

[0030] For digital video streams, the Motion Pictures 
Experts Group (MPEG-2) compression for audio and video 
signals, and MPEG-2 Systems transport for the transport of 
those signals may be used. Because of the high bit rate 
requirements of digital video, a compression method is 
usually applied to a video before transmission over a net- 
work. In the preferred embodiment, video and audio content 
are compressed using MPEG-2 compression, as specified in 
ISO/IEC 13818-2 for video and ISO/IEC 138183-3 for 
audio. 

[0031] The MPEG-2 standard also specifies how presen- 
tations consisting of audio and video elementary streams can 
be multiplexed together in a "transport stream". This is 
specified in the MPEG-2 Systems Specification, ISO/IEC 
13818-1. The MPEG-2 Systems Specification accommo- 
dates the inclusion in a presentation's transport stream of 
non-video and non-audio streams, by use of "private data" 
streams. All transport stream packets, regardless of content, 
are of a uniform size (188 bytes) and format. "Program- 
Specific Information", which is also carried in the transport 
stream, carries the information regarding which elementary 
streams have been multiplexed in the transport stream, what 
type of content they carry, and how they may be demulti- 
plexed. In this embodiment, the control information is 
carried in an MPEG-2 Transport Stream private data stream 
for digital video and audio. 

[0032] After inserting the scheduling and program 
description information, the presentation together with such 
scheduling and program description information may be 
transported to the user's STB by being sent 

[0033] a. in the video blanking interval of an analog 
video signal and extracted by the user's equipment in 
a manner similar to that used for closed-caption 
information; 

[0034] b. in a separate Vestigial Side Band channel; 

[0035] c. within a digital stream, and extraction of 
embedded data is performed by the user's equipment 
in a manner similar to that used for the extraction of 
video, audio and other digital streams. 

[0036] STB 

[0037] The receiving device, in the preferred embodiment, 
is an STB or a PC with a TV tuner card. 

[0038] Shown in FIG. 1 are the specialized hardware 
components for utilizing MPEG-2 compressed multimedia 
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presentations of STBs and digital televisions. A MPEG-2 
demultiplexer 110 accepts the compressed video and audio 
MPEG-2 stream from the Network Interface Module 100, 
breaks the stream into its components, and directs these 
components to the appropriate handling function video 
decoder 140, audio decoder 130 or microprocessor 150. The 
conditional access component 120 regulates the demulti- 
plexer 110 processing. 

[0039] General-purpose microprocessors 150, such as the 
PowerPC 401 are used in STBs and digital televisions for 
controlling MPEG-2 components as well as for executing 
applications such as a program guide used by the viewer. 
The microprocessor can obtain input from the MFEG-2 
stream through the demuitiplexor 110 or from a viewer 
interaction device, such as an infrared remote control con- 
nected to a data port 170. The microprocessor 150 has an 
attached memory storage 160, which is either a random 
access memory (RAM), no n- volatile storage or both. 

[0040] A graphics generator 180 is connected to the micro- 
processor to create an on-screen display (OSD), which is 
merged with the output of the video decoder 140 in the 
Video RAM 190. The OSD generation may be a function of 
the video decoder itself. The resulting output from the audio 
decoder 130 and the Video RAM 190 is then forwarded to 
a monitor with speakers 195 for playback. 

[0041] Processing 

[0042] FIG. 2 shows the program flow of the preferred 
embodiment. At device initialization, a setup option step 200 
allows the viewer to define characteristics of the automatic 
scheduling. These characteristics may include options for 
notification and for schedule execution, as well as whether 
automatic scheduling is enabled. The preferred embodiment 
would present these options to the viewer through the use of 
on-screen graphic menus. The options chosen by the viewer 
would be stored in memory 160 (FIG. 1). 

[0043] Options for notification define how the viewer is 
notified that scheduling information is included in the mul- 
timedia presentation. For instance, a scheduling icon 300 
(FIG. 3), may be displayed on the user receiving device, 
e.g., a video monitor screen or, an audio notification may be 
initiated. Options for schedule execution define what will 
happen at the scheduled time and include automatic tuning 
to the multimedia presentation, textual reminder overlaid on 
the screen, audio reminder or programming a VCR. Once 
these characteristics were selected, they would become part 
of the viewer preferences that are stored in the non-volatile 
memory of the receiving device. The preferences may be 
modified at any time through menu interactions, and mul- 
tiple viewer preference profiles may be stored and selected 
on a single STB, Multiple options for schedule execution 
may be offered to the viewer who responds to a scheduling 
notification. 

[0044] When the viewer selects a multimedia presentation 
to view at step 210, the Program Specific Information is 
parsed to identify the elementary streams therein. In addi- 
tion, the STB apphcation resolves national vs. local tuning 
information, for example, resolving the local NBC network 
broadcast to channel 4 in the New York Qty area. 

[0045] Hie apphcation at step 220, will periodically check 
the data queue located in memory 160 (FIG. 1) for occu- 
pancy. When data is found in the queue, it will be extracted 


and examined al steps 225 and 230 to determine if it carries 
PDI, scheduhng information, both or neither. The schedul- 
ing information may include the following parameters. 

[0046] 1. Presentation time: The time referenced to 
the Program Clock Reference (PGR) carried within 
the MPEG multimedia presentation stream indicat- 
ing when the viewer should be notified that auto- 
scheduling information is available, as well as the 
time when the notification is no longer valid, for 
example at the end of the promotional video clip. 

[0047] 2. Schedule time: The time that the scheduled 
event will become effective in real-time. 

[0048] 3. TYining information: How to tune to a 
scheduled event, including channel number, MPEG 
program number, etc. 

[0049] PDI includes keywords describing the topic area 
and content of the program or data which may be scheduled. 
If it is present along with scheduling information, preference 
information is examined at step 231 to determine if auto- 
matic scheduling is enabled. If so, the PDI is examined at 
step 233 to compare it with keywords stored in the prefer- 
ence information. If there is a match, the event scheduling 
will commence at step 286. 

[0050] If only scheduling information is found the pref- 
erence information is examined at step 232 to determine if 
semi-automatic scheduling is enabled. If so, when the noti- 
fication time arrives, as determined at step 240, the viewer 
will be notified at step 250, according to the manner selected 
in the preferences set at step 200. The viewer then has an 
option of pressing a single key, for example the "Enter** key 
on the infrared remote control, causing the scheduling 
information to be acted upon. The notification display will 
be removed either at step 285 after the viewer has selected 
scheduling by pressing the key at step 280 or at step 270 
after ascertaining that the notification time is over and that 
the end of the interactive portion of the promotional video 
clip is reached. 

[0051] If the user has selected to schedule the event, 
preference information is examined at step 286 to determine 
if it is a "VCR event", i.e., if the user has chosen to see his 
VCR to record events which he selects using the present 
invention. If so, the VCR is programmed at step 287 to 
record the program as indicated in the tuning information 
section of the scheduling information. Otherwise, after pars- 
ing the stored schedule information, the event is scheduled 
at step 288 by use of an which timer is set in the client device 
to activate a tuning application at step 290 at the appropriate 
time for implementation of scheduled events. This event 
application at step 295 may comprise: 

[0052] 1, informing the viewer of the program start- 
ing, 

[0053] 2. allowing the viewer to view and/or hear the 
selected multimedia presentation by tuning the 
device to the broadcast data stream, 

[0054] 3. allowing the viewer to download Software/ 
Data by demultiplexing the desired data and storing 
it as a file on a storage device, such as an STB hard 
disk drive, and 

[0055] 4. programming a VCR by emitting through 
its serial port to an "IR Blaster** device programming 
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control information for the VCR in the form of VCR 
Plus® codes or native programming commands for 
the particular model of VCR. In this case, step 287 
is executed. 

[0056] Any of these mechanisms may be accompanied by 
an on-screen countdown or audio reminders prior to the start 
of the scheduled event. The selected multimedia presenta- 
tion will be displayed based upon selected preferences, by: 

[0057] 1. tuning to the selected multimedia presen- 
tation including turning on the STB/TV if necessary; 

[0058] 2. providing a text/graphics reminder that the 
selected multimedia presentation has started, along 
with a "one button" quick tuning mechanism to assist 
the viewer in tuning to the selected multimedia 
presentation; and 

[0059] 3. providing an audible reminder that the 
selected multimedia presentation has started. 

[0060] While the invention has been particularly shown 
and described with respect to illustrative and preferred 
embodiments thereof, it will be understood by those skilled 
in the art that the foregoing and other changes in form and 
details may be made therein without departing from the 
spirit and scope of the invention that should be limited only 
by the scope of the appended claims. 

Having thus described our invention, what we claim as new, 
and desire to secure by Letters Patent is: 

1. A method for providing a scheduling function to the 
recipient of a muUimedia presentation, said method com- 
prising steps of: 

communicating program scheduling information to a mul- 
timedia broadcast processing device; 

determining whether said program scheduling informa- 
tion was received at said processing device, extracting 
said program scheduling information if it was received, 
and 

placing said program scheduling information in a data 
queue; 

notifying a user of availability of said program scheduling 
information for programming of a future presentation; 

said user making a selection to schedule an event accord- 
ing to said program scheduling information; and 

processing said selection according to contents of said 
program scheduling information. 

2. The method of claim 1, further comprising a step of: 

ascertaining and embedded said program scheduling 
information into a content of said multimedia presen- 
tation during an authoring step. 

3. The method of claim 1, wherein said step of extracting 
further comprising the steps of: 

a. setting preferences and tuning a program selection; 

b. waiting until said program scheduling information has 
been placed on said data queue; and 

c. waiting until a notification time is reached. 

4. The method of claim 3, wherein said steps of notifying 
and making a selection are performed without interrupting 
said multimedia presentation. 


5. The method of claim 4, wherein said step of notifying 
is performed by various notification means, said various 
notifying means being selectable by said user. 

6. The method of claim 5, wherein said multimedia 
presentation is video. 

7. The method of claim 5, wherein said multimedia 
presentation is audio. 

8. The method of claim 5, wherein said notification means 
includes a remote control input device, said step of making 
a selection is performed by a single key press on said input 
device. 

9. The method of claim 6, wherein said step of making a 
selection is performed using an on-screen graphics menu. 

10. The method of claim 9, wherein said step of process- 
ing further comprising following steps: 

d. waiting until said notification time has passed; 

e. terminating the notification of said user of availability 
of said program scheduling information and continuing 
processing at step (b); 

f . determining whether said user has made said selection, 
if said user has not made said selection continuing 
processing at step (d); 

g. terminating the notification of said user of availability 
of said program scheduling information; 

and 

h. waiting until a scheduled presentation time is reached. 

11. The method of claim 10, wherein said step of pro- 
cessing further comprises a step of tuning said processing 
device to a subsequent program at a scheduled time accord- 
ing to said program scheduling information. 

12. The method of claim 11, wherein said step of pro- 
cessing further comprises a step of recording a subsequent 
program at a scheduled time according to said program 
scheduUng information. 

13. The method of claim 12, wherein said step of pro- 
cessing further comprises a step of recording content embed- 
ded in a subsequent program at a scheduled time according 
to said program scheduling information. 

14. The method of claim 13, wherein said step of pro- 
cessing further comprises a step of reminding said user of 
said scheduled event at a scheduled time according to said 
program scheduling information. 

15. The method of claim 14, wherein after said step of 
reminding, the step of allowing said user to tune said 
processing device to said scheduled program by making a 
current selection. 

16. The method of claim 14, wherein said step of remind- 
ing is a video reminder on said processing device. 

17. The method of claim 14, wherein said step of remind- 
ing is an audio reminder on said processing device. 

18. The method of claim 14, wherein said step of making 
a current selection is performed by a single key press on said 
input device. 

19. A computer program device readable by a machine, 
tangibly embodying a program of instructions executable by 
a machine to perform method steps for providing a semi- 
automatic scheduling function to audience of a multimedia 
broadcast presentation, said method comprising steps of: 

communicatiag program scheduling information to a mul- 
timedia broadcast processing device; 
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determining whether said program scheduling informa- 
tion was received at said processing device, extracting 
said program scheduling information if it was received, 
and 

placing said program scheduling information on a data 
queue; 

notifying a user of availability of said program scheduliag 
information for programming of a future presentation; 

said user making a selection to schedule an event accord- 
ing to said program scheduling information; and 

processing said selection according to contents of said 
program scheduling information. 

20. The method of claim 19, further comprising a step of: 

ascertaining and embedded said program scheduling 
information into a content of said multimedia presen- 
tation during an authoring step. 

21. The method of claim 19, wherein said step of extract- 
ing further comprising the steps of: 

a. setting preferences and tuning a program selection; 

b. wailing until said program scheduling information has 
been placed on said data queue; and 

c. waiting until a notification presentation time is reached. 

22. The method of claim 21, wherein said steps of 
notifying and making a selection are performed without 
interrupting said multimedia presentation. 

23. The method of claim 22, wherein said step of noti- 
fying is performed by various notification means, said 
various notifying means being selectable by said user. 

24. The method of claim 23, wherein said multimedia 
presentation is video. 

25. The method of claim 23, wherein said multimedia 
presentation is audio. 

26. The method of claim 23, wherein said notification 
means includes a remote control input device, said step of 
making a selection is performed by a single key press on said 
input device. 

27. The method of claim 24, wherein said step of making 
a selection is performed using an on-screen graphics menu. 

28. The method of claim 27, wherein said step of pro- 
cessing further comprising following steps: 


d. waiting until said notification presentation time has 
passed; 

e. terminating the notification of said user of availability 
of said program scheduling information and continuing 
processing at step (b); 

f. determining whether said user has made said selection, 
if said user has not made said selection continuing 
processing at step (d); 

g. terminating the notification of said xiser of availability 
of said program scheduling information; and 

h. waiting until a scheduled presentation time is reached. 

29. The method of claim 28, wherein said step of pro- 
cessing further comprises a step of timing said processing 
device to a subsequent program at a scheduled time accord- 
ing to said program scheduling information. 

30. The method of claim 29, wherein said step of pro- 
cessing further comprises a step of recording a subsequent 
program at a scheduled time according to said program 
scheduling information. 

31. The method of claim 30, wherein said step of pro- 
cessing further comprises a step of recording content embed- 
ded in a subsequent program at a scheduled time according 
to said program scheduling information. 

32. The method of claim 31, wherein said step of pro- 
cessing further comprises a step of reminding said user of 
said scheduled event at a scheduled time according to said 
program scheduling information. 

33. The method of claim 32, wherein after said step of 
reminding, the step of allowing said user to tunc said 
processing device to said scheduled program by making a 
current selection. 

34. The method of claim 32, wherein said step of remind- 
ing is a video reminder on said processing device. 

35. The method of claim 32, wherein said step of remind- 
ing is an audio reminder on said processing device. 

36. The method of claim 32, wherein said step of making 
a current selection is performed by a single key press on said 
input device. 

* * ★ * « 
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